Total Singulation With Modular Reinforcement Learning
نویسندگان
چکیده
Prehensile robotic grasping of a target object in clutter is challenging because, such conditions, the touches other objects, resulting to lack collision free grasp affordances. To address this problem, we propose modular reinforcement learning method which uses continuous actions totally singulate from its surrounding clutter. A high level policy selects between pushing primitives, are learned separately. Prior knowledge effectively incorporated into learning, through action primitives and feature selection, increasing sample efficiency. Experiments demonstrate that proposed considerably outperforms state-of-the-art methods singulation task. Furthermore, although training performed simulation robustly transferred real environment without significant drop success rate. Finally, tasks different environments addressed by easily adding new primitive retraining only policy.
منابع مشابه
Modular Multitask Reinforcement Learning with Policy Sketches
We describe a framework for multitask deep reinforcement learning guided by policy sketches. Sketches annotate each task with a sequence of named subtasks, providing high-level structural relationships among tasks, but not providing the detailed guidance required by previous work on learning policy abstractions for RL (e.g. intermediate rewards, subtask completion signals, or intrinsic motivati...
متن کاملGlobal Policy Construction in Modular Reinforcement Learning
We propose a modular reinforcement learning algorithm which decomposes a Markov decision process into independent modules. Each module is trained using Sarsa(λ). We introduce three algorithms for forming global policy from modules policies, and demonstrate our results using a 2D grid world.
متن کاملModular Neural Networks and Reinforcement Learning
We investigate the effect of modular architecture in an artificial neural network for a reinforcement learning problem. Using the supervised backpropagation algorithm to solve a two-task problem, the network performance can be increased by using networks with modular structures. However, using a modular architecture to solve a two-task reinforcement learning problem will not increase the perfor...
متن کاملMultiple-Goal Reinforcement Learning with Modular Sarsa(0)
We present a new algorithm, GM-Sarsa(0), for finding approximate solutions to multiple-goal reinforcement learning problems that are modeled as composite Markov decision processes. According to our formulation different sub-goals are modeled as MDPs that are coupled by the requirement that they share actions. Existing reinforcement learning algorithms address similar problem formulations by fir...
متن کاملMultiple-Goal Reinforcement Learning with Modular Sarsa(O)
We present a new algorithm, GM-Sarsa(O), for finding approximate solutions to multiple-goal reinforcement learning problems that are modeled as composite Markov decision processes. According to our formulation different sub-goals are modeled as MDPs that are coupled by the requirement that they share actions. Existing reinforcement learning algorithms address similar problem formulations by fir...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE robotics and automation letters
سال: 2021
ISSN: ['2377-3766']
DOI: https://doi.org/10.1109/lra.2021.3062295